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Abstract 

Recent advances in knowledge compilation introduced techniques to compile positive logic 
programs into propositional logic, essentially exploiting the constructive nature of the least 
fixpoint computation. This approach has several advantages over existing approaches: it 
maintains logical equivalence, does not require (expensive) loop-breaking preprocessing or 
the introduction of auxiliary variables, and significantly outperforms existing algorithms. 
Unfortunately, this technique is limited to negation-free programs. In this paper, we show 
how to extend it to general logic programs under the well-founded semantics. 

We develop our work in approximation fixpoint theory, an algebraical framework that 
unifies semantics of different logics. As such, our algebraical results are also applicable to 
autoepistemic logic, default logic and abstract dialectical frameworks. 


1 Introduction 


There is a fundamental tension between the expressive power of a knowledge repre¬ 
sentation language, and its support for efficient reasoning. Knowledge compilation 
studies this tension (Cadoli and Donini, 1997| Darwiche and Marquis 2002), by 
identifying languages that support certain queries and transformations efficiently. 
It studies the relative succinctness of these languages, and is concerned with building 
compilers that can transform knowledge bases into a desired target language. For ex¬ 


ample, after compiling two CNF sentences into the OBDD language (Bryant 1986) 


their equivalence can be checked in polynomial time. Applications of knowledge 


compilation are found in diagnosis (Huang and Darwiche, 2005), databases (Su- 


ciu et al. 

2011 

, planning (Palacios et al. 2005), graphical models (Chavira and 

Darwiche 

2005 

Fierens et al. 2015) and machine learning (Lowd and Domingos 


2008). These techniques are most effective when the cost of compilation can be 


amortised over many queries to the knowledge base. 

Knowledge compilation has traditionally focused on subsets of propositional logic 


and Boolean circuits in particular (Darwiche and Marquis 2002 Darwiche 2011). 


Logic programs have received much less attention, which is surprising given their 
historical significance in AI and current popularity in the form of answer set pro¬ 


gramming (ASP) (Marek and Truszczyhski 1999). Closest in spirit are techniques 


to encode logic programs into CNF (Ben-Eliyahu and Dechter 1994 Lin and Zhao 


2003 2004 Janhunen, 2004 2006). A notable difference with traditional knowledge 
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compilation is that many of these encodings are task-specific: the resulting CNF 
is not equivalent to the logic program. Instead, it is equisatisjiable for the pur¬ 
pose of satisfiability checking, or has an identical model count for the purpose of 
probabilistic inference (Fierens et al. 20151 ^ These encodings often introduce new 
variables and loop-breaking formulas, which blow up the representation. Lifschitz 


and Razborov (20061 showed that there can be no polynomial translation of ASP 


into a flat propositional logic theory without auxiliary variables]^ 

Recently, Vlasselaer et al. (20151 introduced a novel knowledge compilation tech¬ 


nique for positive logic programs. As an example, consider the logic program V 
defining the transitive closure r of a binary relation e: 

{yX,Y-.r{X,Y) ^e{X,Y). 1 

\ yX, Y, Z : r{X, Y) ^ e(X, Z) A r(Z, Y). j 


Intuitively, Vlasselaer et al. (20151 compute the minimal model of V for all inter¬ 


pretations of e(-, •) simultaneously. They define a lifted least fixpoint computation 
where the intermediate results are symbolic interpretations of r(-,-) in terms of 
e(', •). For example, in a domain {a, 6, c}, the interpretation of r(a, b) in the differ¬ 
ent steps of the least fixpoint computation would be. 


r{a,b) : 


e(a, b) 


e(a, b) V (e(a, c) A e(c, b)) 


I.e., initially, r(a, b) is false; next r(a, b) is derived to be true if e(a, b) holds; finally, 
r(a, b) also holds if e(a, c) and e(c, b) hold. The result of this sequence is a symbolic. 
Boolean formula representation of the well-founded model for each interpretation 
of e; this formula can be used for various inference tasks. This approach has several 
advantages over traditional knowledge compilation methods: it preserves logical 
equivalenc^(and hence, enables us to port any form of inference—e.g., abductive or 
inductive reasoning, (weighted) model counting, query answering, ...) and does not 
require (expensive) loop-breaking preprocessing or auxiliary variables. [Vlasselaer 
et al. (2015) showed that this method for compiling positive programs (into the 
SDD language ( jParwiclie 2011)) significantly outperforms traditional approaches 
that compile the completion of the program with added loop-breaking formulas. 


Unfortunately, the methods of Vlasselaer et al. (2015) do not work in the presence 


of negation, i.e., if the immediate consequence operator is non-monotone. In this 
paper, we show how the well-founded model computation from [Van Gelder et ^ 


(1991), that works on partial interpretations, can be executed symbolically, resulting 


in the parametrised well-founded model. By doing this, we essentially compute the 
well-founded model of an exponential number of logic programs at once. 

Our algorithm works in principle on any representation of Boolean formulas; we 
study complexity for this algorithm taking Boolean circuits as target language; 


1 

2 

3 


Probabilistic inference on the CNF may itself perform a second knowledge compilati on step. 
Similar, tas k-specific, translation tec hniques of logic progra ms into difference logic ||janhunen| 
|et al.||2009|| and ordered completion (jAsuncion et al.||2012|| exist. 

In the sense that an interpretation is a model ot the resulting propositional theory if and only 
if it is a model of the given logic program under the parametrised well-founded semantics. 
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in this case we find that our algorithm has polynomial time complexity. General 
Boolean circuits are not considered to be an interesting target language, as they are 
not tractable for any query of interest. However, what we achieve here is a change 
of semantic paradigm that uncovers all the machinery for propositional logic (SAT 
solvers, model counters, etc.). It is a required step before further compiling the 
circuit into a language such as OBDD or SDD, which do permit tractable query¬ 


ing. It is also possible to encode the circuit into CNF, similar to Janhunen (2004). 


There is a long list of queries and transformations that become supported on logic 
programs (under the well-founded semantics), by virtue of our algorithm. After a 
transformation to propositional logic, we can use standard tools to check whether 
one logic program is entailed by another, find models that are minimal with respect 
to some optimisation term, check satisfiability, count or enumerate models, and for¬ 


get or condition variables (Darwiche and Marquis 20021. For example, the following 


definition of the transitive closure of e syntactically differs from the previous. 

r \fX,Yr{X,Y) ^e{X,Y). 1 

\ yX, Y, Z : r{X, Y) ^ r{X, Z) A r{Z, Y). j 

With our algorithm, we can compile both programs into an OBDD representation. 
On these OBDDs, we can verify the equivalence of the logic programs using existing 
OBDD algorithms. As logic programs under the well-founded semantics encode 


inductive definitions (Denecker and Vennekens 2014), we now have the machinery 


to check that two definitions define the same concept for each interpretation of the 
parameters (e in our example). Moreover, our algorithm can be stopped at any 
time to obtain upper and lower bounds on the fixpoint, which gives us approximate 


knowledge compilation for logic programs (Selman and Kautz 1996). 


The original motivation for this research is the fact that probabilistic inference 


tools such as ProbLog (Fierens et al., 2015) use knowledge compilation for proba¬ 


bilistic inference by (weighted) model counting; they compile a logic program into 
a d-DNNF or SDD (with auxiliary variables) and subsequently calling a weighted 
model counter. Vlasselaer et al. showed that for positive logic programs, this can 
be done much more efficiently using bottom-up compilation techniques. We extend 
these techniques to general logic programs to capture the full ProbLog language. 

More generally, we develop our ideas in approximation fixpoint theory (AFT), 
an abstract algebraical theory that captures all common semantics of logic pro¬ 
gramming, autoepistemic logic, default logic, Dung’s argumentation frameworks 


and abstract dialectical frameworks (as shown by Denecker et al. (2000) and Strass 


(2013)). Afterwards, we show how the algebraical results apply to logic program¬ 


ming. We thus extend the ideas by Vlasselaer et al. (2015) in two ways; first, by 


developing a theory that works for general logic programs and secondly by lifting 
the theory to the algebraical level. Due to the high level of abstraction, our proofs 
are (relatively) compact and our algebraical results are immediately applicable to 
all aforementioned paradigms. Due to page restrictions, proofs are postponed to the 
online appendix (Appendix B) and we only apply our theory to logic programming. 

Summarised, the main contributions of this paper are as follows: (i) we present 
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the algebraical foundations for a novel knowledge compilation technique for general 
logic programs, (ii) we apply the algebraical theory to logic programming, resulting 
in a family of equivalence-preserving algorithms, (in) we show that Boolean circuits 
are at least as succinct as propositional logic programs (under the parametrised 
well-founded semantics), and (iv) we pave the way towards knowledge compilation 
for other non-monotonic formalisms, such as autoepistemic logic. 


2 Preliminaries 


2.1 Lattices and Approximation Fixpoint Theory 

A complete lattice (L, <) is a set L equipped with a partial order < such that 
every subset S oi L has a least upper bounds denoted V S and a greatest lower 
bound, denoted /\S. li x and y are two lattice elements, we use the notations 
X A y = /\{x,y} and x V y = \/{x,y}. A complete lattice has a least element _L 
and a greatest element T. An operator O : L ^ L is monotone ii x < y implies 
that 0{x) < 0{y). Every monotone operator O in a complete lattice has a least 
fixpoint, denoted Ifp(O). A mapping / : (A, <l) — {K,<k) between lattices is a 
lattice morphism if it preserves least upper bounds and greatest lower bounds, i.e. 
if for every subset X of L, /(V A) = V f{X) and f{/\ X) = /\ f{X). 

Given a lattice, approximation fixpoint theory makes uses of the bilattice . We 
define projections as usual: {x,y)i = x and {x,y )2 = y- Pairs {x,y) G are used 
to approximate all elements in the interval [x,y\ = {z \ x < z A z < y}. We call 
(x, y) G consistent ii x < y, that is, if [x, y] is non-empty. We use to denote 
the set of consistent pairs. Pairs (x, x) are called exact. The precision ordering on 
is defined as (x, y) <p {u, v) ii x < u and v <y. In case (u, v) is consistent, (x, y) 
is less precise than (tt, v) if (x, y) approximates all elements approximated by (u, v), 
or in other words if [u, v] C [x, ?/]. If A is a complete lattice, then so is (A^, <p). 

AFT studies fixpoints of operators O : L ^ L through operators approximating 
O. An operator A : A^ —> A^ is an approximator of O if it is <p -monotone, and has 
the property that for all x, 0(x) G A(x,x). Approximators are internal in A'^ (i.e., 
map A° into A*^). As usual, we restrict our attention to symmetric approximators: 


approximators A such that for all x and y, A(x,y)i = A{y,x) 2 . Denecker et al. 


(20041 showed that the consistent fixpoints of interest are uniquely determined by 


an approximator’s restriction to A'’’, hence, we only define approximators on A'’’. 

AFT studies fixpoints of O using fixpoints of A. The A-Kripke-Kleene fixpoint is 
the <p -least fixpoint of A and has the property that it approximates all fixpoints 
of O. A partial A-stable fixpoint is a pair (x,y) such that x = lfp(A(-,y)i) and 
y = lfp(A(x, •) 2 ). The A-well-founded fixpoint is the least precise partial A-stable 
fixpoint. An A-stable fixpoint of O is a fixpoint x of O such that (x, x) is a partial A- 
stable fixpoint. The A-Kripke-Kleene fixpoint of O can be constructed by iteratively 


applying A, starting from (T,T). For the A-well-founded fixpoint, Denecker and 


Vennekens (2007) worked out a similar constructive characterisation as follows. 

An A-refinement of (x,y) is a pair {x',y') G Lf satisfying one of the following 
conditions (i) (x, y) <p (x', y') <p A(x, y), or (ii) x' = x and A(x, y ')2 < y' < y. An 
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A-refinement is strict if {x,y) {pc',y'). We call refinements of the first kind appli¬ 
cation refinements and refinements of the second kind unfoundedness refinements. 
A well-founded induction of A is a sequence {xi, yi)i<i 3 with fi an ordinal such that 


• {xo,yo) = (-L,T); 

• {xi+i,yi+i) is an A-refinement of {xi,yi), for all i < j3\ 

• {xx,y\) = V< I * < foi' each limit ordinal \< j3. 


A well-founded induction is terminal if its limit (xp, yp) has no strict A-refinements. 
For a given approximator A, there are many different terminal well-founded induc¬ 
tions of A. Denecker and Vennekens (20071 showed that they all have the same limit, 
which equals the A-well-founded fixpoint of O. Denecker and Vennekens (20071 also 
showed how to obtain maximally precise unfoundedness refinements. 


Proposition 2.1 ^Denecker and Venneken^ 2001] 

Let A be an approximator of O and (x, y) & Lfi. Let S\ be the operator on L that 
maps every y' to A{x,y') 2 . This operator is monotone. The smallest y' such that 
{x,y') is an unfoundedness refinement of {x,y) is given by y' = lfp(S'^). 


2.2 Logic Programming 


In this paper, we restrict our attention to propositional logic programs. However, 


AFT has been applied in a much broader context (Denecker et al.l 2000 Pelov 


et al. 2007 Antic et al. 20131 and our results apply in these richer settings as well. 


Let S be an alphabet, i.e., a collection of symbols called atoms. A literal is 
an atom p or its negation ^p. A logic program 7^ is a set of rules r of the form 
h ■<— Zi A Z2 A • • • A where h is an atom called the head of r, denoted head{r), and 
the k are literals. The formula Zi A Z2 A • • • A is the body of r, denoted body{r). A 
rule r = W : h is, as usual, a shorthand for the grounding of r, the collection 
of rules obtained by substituting the variables X by elements from a given domain. 
If p S E, the formula ipp is \lr^v/\head(r)=p body{r). An interpretation / of the 
alphabet S is an element of 2^, i.e., a subset of E. The set of interpretations 2^ 
forms a lattice equipped with the order C. The truth value (t or f) of a propositional 
formula p in a structure /, denoted (p^ is defined as usual. With a logic program V, 
we associate an immediate consequence operator ( van Emden and Kowalsld| 19761 
T-p mapping structure / to Tp{I) = {p | = t}. 

In the context of logic programming, elements of the bilattice (2^)^ are four¬ 
valued interpretations, pairs X = (/i,/ 2 ) of interpretations. A four-valued interpre¬ 
tation maps atoms p S E to tuples of two truth values {p^^,p^^). Such tuples 
are often identified with four-valued truth values (true (t), false (f), unknown 
(u) and inconsistent (i)). Intuitively, p^^ represents whether p is true, and p^^ 
whether p is possible, i.e., not false. Thus, the following correspondence holds 
t = (t,t),f = (f, f),u = (f,t) (and i = (t,f)). The pair {hjh) approximates 
all interpretations I' with C I' C I 2 . We are mostly concerned with consistent 
(also called partial) interpretations: tuples (/i,/2) with Ii C I2, i.e., interpretations 
that map no atoms to i. If I is a partial interpretation, and p a formula, we write 
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for the standard three-valued valuation based on Kleene’s truth tables (Kleene 


1938). We often identify interpretation / with the partial interpretation {1,1). 


The most common approximator for logic programs is Fitting’s (2002) immediate 
consequence operator , a generalisation of Tp to partial interpretations: 

= {a G S I 3r G 7^ : body{r)^ = t A head{r) = a}, 

^p{I )2 = {a G S I 3r G 7^ : body{r)^ 7 ^ f A head{r) = a} 


Denecker et al. ( 2000| showed that the d>-p-well-founded fixpoint of Tp is the well- 
founded model of V (I Van Gelder et al.l 119911) and that 'I'-p-stable fixpoints are 


exactly the stable models of V (Gelfond and Lifschitz 1988). 


Parametrised Logic Programs We briefly recall the parametrised well-founded se¬ 
mantics. This semantics has been implicitly present in the literature for a long time, 
by assigning a meaning to an intensional database. We follow the formalisation by 
Denecker and Vennekens (2007). For parametrised logic programs, the alphabet S 


is partitioned into a set Ep of parameter symbols and a set of defined symbols. 
Only defined symbols occur in heads of rules. Given a Ep-interpretation I, V de¬ 
fines an immediate consequence operator : 2^“^ —2^“^ equal to Tp except that 
the value of atoms in Ep is fixed to their value in I. Similarly, Fitting’s immediate 
consequence operator induces an operator on (2^“*)^. J is a of V un¬ 

der the parametrised well-founded semantics (denoted J \=wf V) if J Cl E^ is the 

By adding a probability distribution over 


^jnSp-weii-fQunded fixpoint of 


the parameter symbols, we obtain the ProbLog language (Fierens et al. 2015). 


3 Algebraical Theory 

In this section we develop the algebraical foundations of our techniques. We fol¬ 
low the intuitions presented in the introduction: we define one operator that “sum¬ 
marises” an entire family operators (these will be immediate consequence operators 
for different interpretations of the parameter symbols). We study the relationship 
between the well-founded fixpoint of the summarising operator and the original op¬ 
erators. Before formally introducing parametrisations, we focus on a simpler situa¬ 
tion: we show that surjective lattice morphisms preserve the well-founded fixpoint. 

3.1 Surjective Lattice Morphisms 

Definition-Proposition 3.1 

Let O : L —>■ L be an operator and f : L ^ K a lattice morphism. We say that O 
respects f if for every x,y G L with f{x) = f{y), it holds that f{0{x)) = f{0{y)). 

If / is surjective and O respects /, then there exists a unique operator Of : K ^ 
K with Ofof = foO, which we call the projection of O on K. 

^ Note that this definition of model differs from the traditional definition of model of a logic 
program. To emphasise this difference, we use J \=wf P to refer to the parametrised well- 
founded semantics and J |= T for the satisfaction relation of propositional logic. 
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If / : L —^ if is a lattice morphism, p : L'^ ^ if^ : {x,y) !->■ (/(x),/(y)) is a 
lattice morphism from the bilattice Lf to the bilattice . 


Definition 3.2 

Let A : Lf ^ Lf he an approximator and f : L ^ K a lattice morphism. We say 
that A respects f ii A respects in the sense of Definition 3.1 Furthermore, if / is 
surjective, we define the projection of A on if as the unique operator Af : —>■ if^ 
with Af o f"^ = f"^ o A. 


Below, we assume that / : L —)• if is a 
surjective lattice morphism, that O : L ^ L 
is an operator and A : —>■ an approxi¬ 
mator of O such that both O and A respect 
/ (see Figure [^. Intuitively elements of L 
can be thought of as symbolic representa¬ 
tions of interpretations, while the elements 
of if are classical interpretations. 

The following proposition explicates the relationship between well-founded induc¬ 
tions in L and in if. This proposition immediately leads to a relationship between 
the A-well-founded model of O and the A/-well-founded model oi Of. 


o0(L,<)^^(if,<)3o, 

Fig. 1. Overview of the operators 


Proposition 3.3 

If (xj,yj)j<:a is a well-founded induction of A, then {f{xj),f(yj))j<:a is a well- 
founded induction of Af. If {xj,yj)j<a is terminal, then so is {f{xj),f{yj))j<:a. 


Theorem S.j 

If (x, y) is the A-well-founded fixpoint of O, then, {f{x),f{y)) is the A/-well-founded 
fixpoint oi Of. 


3.2 Parametrisations 


Definition 3.5 

Let L and if be lattices. Suppose {fi:L^ K)iei is a family of surjective lattice 
morphisms. We call L a parametrisation of if (through {fi)i^i) if for every x,y G L 
it holds that x <y ii and only if for every i G I, fi{x) < fi{y). 

A parametrisation L of a lattice if can be used to “summarise” multiple operators 
(the Of.) on if by means of a single operator O on L which abstracts away certain 
details. In the next section, we use this to compute a symbolic representation of 
the parametrised well-founded model. 

Theorem 3.6 

Suppose L is a parametrisation of if through {fi)i^i. Let O : L —> L be an operator 
and A an approximator of O such that both O and A respect each of the fi. If (x, y) 
is the A-well-founded fixpoint of O, the following hold. 

1. For each i, {fi{x),fi{y)) is the A/.-well-founded fixpoint of Of.. 

2. If the -well-founded fixpoint of Of. is exact for every i, then so is the 
A-well-founded fixpoint of O. 
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4 Operator-Based Knowledge Compilation 


We assume throughout this section that V refers to a parametrised logic program 
with parameters Ep and defined symbols S^. In order to apply our theory to logic 
programming, we will define an operator (and approximator) that summarises the 
immediate consequence operators of V for all Ep-interpretations. 

Partial interpretations map defined atoms to a tuple (t,p) of two-valued truth 
values. We generalise this type of interpretations: we want (partial) interpretations 
to be parametrised in terms of the parameters of the logic program. Instead of 
assigning a tuple (t,p) of Boolean values to each atom, we will hence assign a tuple 
of two propositional formulas over Ep to each atom in E^. 

In order to avoid redundancies, we work modulo equivalence. Let £ 3 ^ be the 
language of all propositional formulas over vocabulary Ep. If tp is a propositional 
formula, we use (p to denote the equivalence class of tp, i.e., the set of propositional 
formulas equivalent to Let Lp be the set of equivalence classes of elements 
in /isp. We define an order <Lj, on Lp as follows: (p <Lj, ip V entails ip (in 
standard propositional logic). This order is well-defined (independent of the choice 
of representatives p and ip); with this order, Lp is a complete lattice. Boolean 
operations on Lp are defined by applying them to representatives. 


Definition f.l 

A symbolic interpretation of E^ in terms of Ep is a mapping Yid ^ Lp. The symbolic 
interpretation lattice Lp is the set of all symbolic interpretations of E^ in terms 
of Ep. The order < on Lp is the pointwise extension of <Lp. A partial symbolic 
interpretation is an element of the bilattice {t,p) G (Lp)"^ such that t <p. 


The condition t < p in Definition 4.1 excludes inconsistent interpretations. If Ep is 
the empty vocabulary (i.e., if V has no parameters), then the lattice Lp is {f, t} with 
order f < t. Hence, in this case, a (partial) symbolic interpretation is “just” a (par¬ 
tial) interpretation. As with classical interpretations, we often identify a symbolic 
interpretation A with the partial symbolic interpretation (A, A). 

Intuitively, a (partial) symbolic interpretation summarises many different classi¬ 
cal (partial) interpretations; when we instantiate such as (partial) symbolic inter¬ 
pretation with a Ep-interpretation, we obtain a unique (partial) E^-interpretation. 
The following definition formalises this intuition. 


Definition 4.2 

If 5 = {At,Ap) is a partial symbolic interpretation and I is a Ep-interpretation, the 
concretisation of 5 by / is the partial interpretation such that for every symbol 
a G Yd with At{a) = tpl and Ap{a) = pp, it holds that S^{a) = {pp^ Pp). 

The above concept is well-defined (independent of the choice of representatives 
Pt en Pp). A symbolic interpretation can thus be seen as a mapping from Ep- 
interpretations to E^-interpretations. This kind of mapping is of particular inter¬ 
est, since the parametrised well-founded semantics induces a similar mapping: it 


® Notice that a is not the negation of an atom a. We use -<a for the negation of a. 
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associates with every Sp-interpretation a S^-interpretation, namely the 'h|,-well- 
founded model of Tj,. It is this relationship between Sp- and S^-interpretations 
that we wish to capture in propositional logic. Furthermore, as explained below, it 
is easy to translate a symbolic interpretation into propositional logic. 

Definition 4.3 

Let Ahe a symbolic interpretation and ipp a representative of A(p) for each p G 
We call a propositional theory T a theory of A if it is equivalent to Ap^SdP 

All theories of A are equivalent. We sometimes abuse notation and refer to the 
theory of A, denoted Th{A), to refer to any theory from this class. The goal now is 
to find a symbolic interpretation A such that Th{A) is equivalent to V. Our choice 
of representatives will depend on the target language of the compilation. 

The value of a propositional formula (/j in a partial interpretation X is an element 
of {t, f, u} ( or, a tuple of two Booleans) obtained by standard three-valued valua¬ 
tion. This can easily be extended to symbolic interpretations, where the value of a 
formula in a (partial) symbolic interpretation is a tuple of two Ep formulas. 

Definition 4-4 

Let ip he a E-formula and S = {At,Ap) a partial symbolic interpretation. The value 
of (/? in 5 is a tuple {(pt,Tp) G defined inductively as follows: 

• = {p,p) ifp e Ep and = {At{p), Ap{p)) if p G E^, 

. V V andg(-^^-^.-) = (6,?p) 

• jf ^{At,Ap) = (• 0 j,i/)p). 

Evaluation of formulas has some nice properties. It commutes with concretisation 
(Proposition |4.5[ ) and induces a parametrisation (Proposition |4.6[ ) . 

Proposition 4-5 

For every formula p over E, 5 € ^md I G it holds that = {p'^)^■ 


Proposition 4-6 

The lattice is a parametrisation of 2^"^ through the mappings (tt/ : L)) —2^“^ : 

A i-A A^) j^2^p ■ 


Recall from Section 2.2 that Pp is the disjunction of all bodies of rules defining 
p; using this we can generalise both T-p and dt-p to a symbolic setting. 


Definition 4 A 

The partial parametrised immediate consequence operator Pp : -G {L^Y is 

defined by Pp{S){p) = Pp for every p GTid- 

The parametrised immediate consequence operator is the operator 7p : Lp —>■ Lp 
that maps A to Tp{A), where Tp{A){p) = p^ for each p G E^. 


It deserves to be noticed that the operator Tp almost coincides with the operator 
Tcj, defined by Vlasselaer et al. ( 2015| (the only difference is that we work modulo 
equivalence). The following proposition, which follows easily from our algebraical 
theory, shows correctness of the methods developed by IVlasselaer et al.l (12015 1. 
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Theorem 4-8 

If 7^ is a positive logic program, then Tv is monotone. For every E-interpretation 
I, it then holds that / \=wf V if and only if / ^ T/i(lfp(7p)). 

Theorem 4-9 

For any parametrised logic program V, the following hold: 

1 . Tv is an approximator of Tv- 

2. For every Ep-structure I, it holds that o 7r| = 7r| o Tv- 
Definition 4-10 

Let V be any parametrised logic program. The parametrised well-founded model of 
V is the iF-p-well-founded fixpoint of Tv- 

Applying Theorem |3.4[ combined with Proposition |4.5| and Theorem |4.9| yields: 

Theorem 4-11 

If the parametrised well-founded model of V is exact, i.e., of the form {A^A) for 
some symbolic interpretation A, then for every E-interpretation /, it holds that 
I \=wf V if and only if / ^ Th{A)- 

Example 4-111 

We illustrate the various concepts introduced above on the smokers problem, a 
popular problem in probabilistic logic programming. Consider a group of people. A 
person of this group smokes if he is stressed, or if he is friends with a smoker. This 
results in the following logic program Vs with a domain of three people {a, b, c}: 

J yX : smokes{X) ^ stress{X) 1 

\ yX,Y ■-smokes{X) ^ fr{X,Y)/\ smokes(Y) j 

This program has parameters stress{■) and /r(-, •) and defined symbols smokes{-)- 
The parametrised well-founded model of Vs is the symbolic interpretation As ■ 
Lp ■- such that 

As{smokes{a)) =stress{a) V (stress{b) Afr{a,b)) V {stress{c) Afr{a,c)) 
y{stress{c) A fr{b, c) A fr{a, b)) 
y{stress{b) A fr{c, b) A fr{a, c)) 

and symmetrical equations hold for smokes {b) and smokes{c)- 

Notice that Th{As) is equivalent to Vs, in the sense that J ^ Th{As) if and only 
if J \=wf Vs- For example, let I be the Ep-interpretation {stress{a),fr{b,a)}. We 
know that the Tip -well-founded fixpoint of T-p is I' := {smokes {a), smokes {bf}', 
this equals Al and J U J' is indeed a model of Th{As)- 

Since Vs is positive, Tv^ is monotone and its least fixpoint can be computed by 
iteratively applying the operator Tv, starting from the smallest symbolic interpre¬ 
tation; this yields the following sequence (only the value of smokes (a) is explicated; 
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for smokes(b) and smokes(c), similar equations hold): 


_L : smokes (a) f 

7p^(-L) : smokes{a) i—>■ stress{a) 

7p^(-L) : smokes{a) i—)■ stress{a) V {stress{b) Afr{a,b)) V {stress{c) Afr{a,c)) 

As. 


In Figure a circuit representation of Th{As) is depicted. In this circuit, the 
different layers correspond to different steps in the computation of the parametrised 
well-founded model of Vs- Figure [^essentially contains proofs of atoms smokes{-); 
this illustrates that the compiled theory can be used for example for abduction. 


Th{A,) 



Fig. 2. A circuit representation of the smokers theory Th{As) and the different 
steps in the computation of . 

For general logic programs, Tp is not guaranteed to be monotone and hence the 
parametrised well-founded model cannot be computed by iteratively applying 7p. 
Luckily, well-founded inductions provide us with a constructive way to compute it. 

Example 

Consider a dynamic domain in which two gear wheels are connected. Both wheels 
can be activated by an external force; since they are connected, whenever one wheel 
turns, so does the other. Both wheels are connected to a button. If an operator hits 
the button associated to some gear wheel, this means that he intends the state of 
the wheel to change (if a wheel was turning, its external force is turned off, if the 
wheel was standing still, its external force is activated). If the operator does not hit 
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the button, the external force is set to the current state of the wheel. Initially, both 
external forces are inactive. This situation (limited to two time points) is modelled 
in the following logic program Vw {turnsi(T) means that wheel i is turning at time 
point T and buttoni(T) means that the button of wheel i is pressed at time T): 

{ turnsi{ 0 ) -^r- turns 2 { 0 ) turns 2 { 0 ) ^ turnsi{ 0 ) 'j 

turnsi{l) ^ turns 2 {l) turns 2 {l) turnsi{l) I 

turnsi{l) ^ turnsi{0) A ^button\{Q) turns 2 {V) •(— turns 2 { 0 ) A -^button 2 { 0 ) I 

turnsi{l) ^ ^turnsi{0) A button\{Q) turns 2 {V) ^ ^turns 2 { 0 ) A button 2 { 0 ) } 

This logic program has defined symbols turns.{■) and parameters button.{■). The 
parametrised well-founded model of Vw is computed by a well-founded induction 
of . We start from the least precise partial symbolic interpretation, i.e., Sq that 
maps every turns.{•) to (f, t). Since is a fixpoint of the only possible type 
of refinement is unfoundedness refinement, resulting in Si that maps 

twmsi(O) (f, f) tMrns2(0) !->■ (f,f) 

turnsi{l) I—(f,t) turns 2 {i) (fjt) 

Application refinement then results in the partial symbolic interpretation ^2 = 
'Fp^{Si) that maps 

turnsi{0) i-A (f,f) turns 2 { 0 ) >—t (f,f) 

turnsi{l) I— {buttoni{0),i) turns 2 {i) >—t {button 2 { 0 ),i) 

Another application refinement then results in the partial symbolic interpretation 
S 3 = 'Bp^{S 2 ) that maps 

tMrnsi(O) !->■ (f,f) tMr?rs2(0) (f, f) 

tumsi{\) !->■ {buttoni[Q) V button2{0),i) turns 2 {l) {button2{0) V buttoni{0),i) 

Finally, one last unfoundedness refinement results in the symbolic interpretation 
Aw that maps 

turnsi{0) I—?► f turns 2 { 0 ) 1 —>■ f 

turnsi{l) I—)■ buttoni{Q) V button 2 {V) turns 2 {V) 1 — buttoni{0) V button2{0) 

In Figure A.l in online Appendix A, a circuit representation of Th[Aw) is de¬ 
picted. In this circuit, the different layers correspond to the evolution of the lower 
bound in different steps in the computation of the parametrised well-founded model 
of Vw (unfoundedness refinements are not visualised). In Figure A.2, the circuit for 
this examples with time ranging from 0 to 2 is depicted. 


Example 4-14 {Example 4-12 continued) 

Well-founded inductions also work for positive logic programs. Let Sq denote the 
least precise partial interpretation. Since Vs is positive, it holds for every i and X 
that 


'Ep^{Sti){smokes{X)) = {Tp ^{E) {smokes {X)) A)- 
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Hence, repeated application refinements yield the partial symbolic interpretation 
(yls, T). One final unfoundedness refinement then results in the parametrised well- 
founded model of Vs, namely As- 


Discussion 


The condition in Theorem |4.11| naturally raises the question “what happens if the 
parametrised well-founded model is not exact?”. First of all, our techniques also 


work in this setting. Indeed, Theorem 3.6 (1) guarantees that instantiating the the 


parametrised well-founded model of V with a Sp-interpretation / results in the 
4'1,-well-founded fixpoint of T-p. 


Example 4-15 

Let Vnt be the following logic program 


{ 


nb. 


-'b c ^ e. d ^ a f\ ^c. } 


with parameter symbol e and defined symbols a, b, c and d. The parametrised well- 
founded model of Vnt is then Snt such that 

5]VT(a) = (f, t) 5 jvt(&) = (f, t) 5ArT(c) = (e, t) 5jvT(d) = (f, 

However, in this text we mainly focus on programs with an exact parametrised 
well-founded model. Corollary |3.6| guarantees that this condition is satisfied for 
all logic programs in which the standard well-founded model is two-valued. This 


kind of programs is common in applications for deductive databases (Abiteboul and 


Vianu, 1991) and for representing inductive definitions (Denecker and Vennekens 


2014[). Classes that satisfy this condition include monotone and (locally) stratified 


logic programs (Przymusinski 1988). 


This restriction is typically not satisfied by ASP programs, where stable semantics 
is used. However, it deserves to be stressed that there is a strong relationship 
between ASP programs and logic programs under the parametrised well-founded 
semantics. Most ASP programs, e.g., those used in ASP competitions, are so-called 
generate-define-test (GDT) programs. They consist of three modules. A generate 
module opens the search space (i.e., it introduces parameter symbols); a define 
module contains inductive definitions for which well-founded and stable semantics 


coincide (as argued by Denecker and Vennekens (2014)) and a test module consist 


of constraints. Denecker et al. 


(2012) have argued that a GDT program is the 


monotone conjunction of its different modules. Hence, our technique can be used 
to compile the define part of a GDT program. The example below illustrates that 
only compiling this part results in an interpretation that captures the meaning of 
this definition more closely, by preserving more structural information. 


Example 4-16 {Example 4-15 continued) 

The first two rules of Vnt encode a choice rule for a (or b). The define module of 
this program is the program 


'Pdef = {&•«— -^a. c-^ ^b 


c •<— e. 


d <— a A —'C. } 
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with parameter symbols a and e, and defined symbols b, c and d. The parametrised 
well-founded model of Vdef is the symbolic interpretation Adef such that 

Adef(b)=^ Adefic) = a V e ^de/(d) = a A ^(a V e) = f 

As can be seen, the parametrised well-founded model now contains the information 
that d is false, independent of the value of the parameter symbols (independent of 
the choice made in the choice rules in the original example). 


5 Algorithms 

Based on the theory developed in the previous section, we now discuss practical 
algorithms for exact and approximate knowledge compilation of logic programs. 


5.1 Exact Knowledge Compilation 


The definition of a well-founded induction provides us with a fixpoint procedure 
to compute the parametrised well-founded model. Our algorithms are parametrised 
by a language £, referred to as the target language] this can be any representation 
of propositional formulas. We describe our algorithm, which we call Compile(£), 
as a (non-deterministic) finite-state-machine. A state © consists of an assignment 
of two formulas 6t(q) and &p{q) in C (over vocabulary Sp) to each atom q G 
Hence, a state © corresponds to the partial symbolic interpretation Sq = {At,Ap) 
such that for each q G Sd, At(q) = &t(q) and Ap(q) = &p{q). The transitions in 
our finite-state-machine are exactly those tuples of states (©,©') such that Sq' is 
a -refinement of iSs- 

We further restrict these transitions to maximally precise transitions: application 
refinements that refine S to 'B'p{S) and unfoundedness refinements as described 
in Proposition |2.1[ Furthermore, we propose to make the resulting finite-state- 
machine deterministic by prioritising application refinements over unfoundedness 
refinements since they are cheaper, i.e., they only require one application of 'I'-p. 

The final output of Compile(£) is a theory Th{A) in £, where A is the parametrised 
well-founded model of V. When C denotes Boolean circuits, each application of ^-p 
adds a layer of Boolean gates over the circuits in ■ When C denotes a language 


with a so-called Apply function (Van den Broeck and Darwiche, 2015) (e.g., SDDs) 


each application of iFp calls Apply to conjoin or disjoin circuits from Sg- 

Figure contains an example circuit for the smokers problem (Example |4.12 ). 
The different layers in the circuit correspond to different steps in a well-founded in¬ 
duction (or the least fixpoint computation). Our algorithm follows the well-founded 
induction as described in Example |4.14[ by prioritising application refinements over 
unfoundedness refinements. Similarly, our algorithm also follows the well-founded 
induction from Example |4.13[ During the execution, circuits to represent the upper 
and lower bounds are gradually built (layer by layer). 


Theorem 5.1 

Let C BC be the language of Boolean circuits. The following hold: (i) Compile(£ bc) 
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has polynomial-time complexity and (ii) the size of the output circuit of Compile(£bc') 
is polynomial in the size of V. 


In the terminology of Darwiche and Marquis (2002), this means that Boolean cir¬ 
cuits are at least as succinct as logic programs under the parametrised well-founded 
semantics. With other languages, for example when C denotes OBDDs or SDDs, 
our algorithm can take exponential time, and its output can take exponential space 
in the size of V. This is not surprising given the fact these languages support many 
(co-)NP hard inference tasks in polynomial time. Because they support equivalence 
checking (which is convenient to detect fixpoints early) and have a practically ef¬ 
ficient Apply function ( Van den Broeck and Darwiche[ 20151, OBDDs and SDDs 
are excellent languages for use in Compile. 


5.2 Approximate Knowledge Compilation 


The above section provides us with a way to perform various types of inference on 
logic programs: we can compile any logic program into a target formalism suitable 
for inference (e.g., SDD for equivalence checking or weighted model counting, CNF 
for satisfiability checking, etc.). However, when working with large programs this 
approach will be infeasible, simply because compilation is too expensive. In this 


case, we often want to perform approximate knowledge compilation (Selman and 


Kautz 1996). Well-founded inductions provide us with the means to do this. 


Proposition 5.2 

Suppose the parametrised well-founded model of V is {A, A). Let {Aip,Ai, 2 ) be a 
well-founded induction of T-p. Then for every i, Th{Aip) \= Th{A) ^ Th{Ai^ 2 )- 


One application of approximate knowledge compilation is in approximate inference 
by weighted model counting (WMC) ( Chavira and Darwiche[ 2008| ) for probabilistic 
logic programs ( Fierens et al.[ 2015| ). Let p he a, formula (query) over E and w a 
weight function on E. Then it follows immediately from Proposition |5.2| that 


WMC{Th{Aip) A^,w)< WMCiP /\(p,w)< WMC(r/i(A, 2 ) A tp, w). 

As Compile(£) follows a well-founded induction, it can be stopped at any time to 
obtain an upper and lower bound on the weighted model count (and therefore on 


the probability of the query). In fact. Proposition 5.2 can be used to perform any 
(anti)-monotonic inference task approximately. 


6 Conclusion 

In this paper, we presented a novel technique for knowledge compilation of general 
logic programs; our technique extends previously defined algorithms for positive 
logic programs. Our work is based on the constructive nature of the well-founded 
semantics: we showed that the algebraical concept of a well-founded induction trans¬ 
lates into a family of anytime knowledge compilation algorithms. We used this to 
show that Boolean circuits are at least as succinct as logic programs (under the 
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parametrised well-founded semantics). Our technique also extends to Kripke-Kleene 
semantics and to other knowledge representation formalisms. Extending the imple¬ 
mentation by Vlasselaer et al. (2015) to general logic programs and testing it on a 
set of benchmarks are topics for future work. 
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7 Figures 


This appendix contains some figures associated with the gear wheels example (Ex¬ 
ample 4.131. The first figure contains a circuit representation of the parametrised 


well-founded model of logic program from Example 4.13 


Th{A^) 



Fig. 3. A circuit representation of the gear wheel theory Th{Aw)- 


The next figure contains a circuit representation of the parametrised well-founded 
model of the following logic program 'Pw ,2 that represent the gear wheel example 
with time ranging from 0 to 2: 


tumsi{Q) -(r- turns 2 ( 0 ) 

turnsi(l) ^ turns 2 (l) 

turnsi(2) ^ turns 2 ( 2 ) 

turnsi(l) turnsi(O) A ^buttoni(O) 

turnsi(l) -^turnsi(O) A buttoni(0) 

turnsi{2) turnsi{l) A ^buttoni{l) 

turnsi{2) —'turnsi{l) A buttoni{\) 


turns 2 { 0 ) ^ turnsi{0) 

turns 2 {l) ^ turnsi{l) 

turns 2 { 2 ) •<— turnsi{2) 

turns2(X) ■‘r- turns2{U) A ^button2{0) > 

turns2{l) ^ —~turns2(U) A button2{0) 

turns2{2) ^ turns2{i) A ^button2{l) 

turns2{2) ^ —'turns2(^) A button2(X) 
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8 Proofs 


Definition-Proposition 3.1 
Let O : L —>■ L be an operator and f : L ^ K a lattice morphism. We say that O 
respects f if for every x,y G L with f{x) = f{y), it holds that f{0{x)) = f{0{y)). 

If / is surjective and O respects /, then there exists a unique operator Of : K ^ 
K with Ofof = foO, which we call the projection of O on K. 


Proof 

We prove the existence and uniqueness of Of. 

Choose X G K. Since / is surjective, there \s a x’ G L with f{x') = x. We 
know that Of must map x to f{0{x')), hence uniqueness follows. Furthermore, 
this mapping is well-defined (independent of the choice of x') since O respects 
/. □ 

Proposition A.l 

If {x',y') is an A-refinement of {x,y), then {f{x'),f{y')) is an ^/-refinement of 
{f{x)Jiy)). 

Proof 

1. First suppose {x',y') is an application yl-refinement of {x,y). Thus 

{x,y) <p {x',y') <pA{x,y). 

From the fact that / is a lattice morphism, it follows that 
f{x, y) <p fix, y') <p fiA{x, y)). 

From the fact that / respects A, we then find 

fix, y) <p fix', y') <p Afifix, y)), 
hence fix',y') is an application ^/-refinement of fix,y). 

2. The second direction is analogous to the first. Suppose (a;', y') is an unfoundedness 
A-refinement of ix,y). Thus x' = x and 

Aix,y')2 <y' <y- 

Then also fix') = fix) and 

fiAix,y')2) < fiy') < fiy), 

thus 

Afifix), fiy'))2 < fiy') < fiy) 

and the result follows. 

Lemma A.2 

If O and Of are monotone, then /(Ifp(O)) = lfp(0/). 
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Proof 

The least fixpoint of O is the limit of the sequence _L —>■ 0(-L) —>■ 0(0(_L)) It 

follows immediately from the definition of Of that for every ordinal n, /(0"(_L)) = 
0^(/(_L)) = 0”(_Lif), hence the result follows. □ 


Proposition \3.^ 

If is a well-founded induction of A, then {f{xj),f(yj))j<:a is a well- 

founded induction of Af. If {xj,yj)j<a is terminal, then so is {f{xj),f{yj))j<:a- 


Proof 

The first claim follows directly (by induction) from Proposition A.l 


For the second claim, all that is left to show is that if there are no strict A- 
refinements of (a;^, ya), then there are also no strict ^/-refinements of {f{xa), /(j/a))- 
First of all, since {xa,ya) is a fixpoint of A, it also follows for every i that 
^f{f{xa),f{ya)) = P{A{xa,ya)) = if (xa), f iVa))■ Thus, there are no strict ap¬ 
plication refinements oi Af either. 


Since there are no unfoundedness refinements of {Xa,ya), Proposition 2.1 yields 


7tV 


that ya = lfp*S') 4 . It is easy to see that for every i, the operator f o S\ = 

Hence, Lemma A.2 (for the ope rator S\) guarantees that f(ya) = /(IfP'S'^) = 
Ifp . Thus, using Proposition 
refinement of {f{xa),f{ya))- 
□ 


2.1 


we find that there is no strict unfoundedness 


Theorem \3.4\ 

If (x, y) is the A-well-founded fixpoint of O, then, {f{x),f{y)) is the A/-well-founded 
fixpoint oi Of. 


Proof 

Follows immediately from Proposition 


3.3 


□ 


Theorem 1 ,9. 61 

Suppose L is a parametrisation of K through {fi)i^i. Let O : L —> L be an operator 
and A an approximator of O such that both O and A respect each of the fi. If (x, y) 
is the A-well-founded fixpoint of O, the following hold. 

1. For each i, {fi{x),fi{y)) is the A/.-well-founded fixpoint of Of.. 

2. If the A/.-well-founded fixpoint of Of. is exact for every i, then so is the 
A-well-founded fixpoint of O. 







Knowledge Compilation of Logic Programs Using AFT 


23 


Proof 

The first point immediately follows from Theorem 3.4 


Using the first point, we find that if the -well-founded fixpoint of Of. is exact 
for every i, then fi{x) = fi{y) for every i. Hence the definition of parametrisation 
guarantees that x = y as well, i.e., the H-well-founded fixpoint of O is indeed exact. 

□ 


Proposition \4-5\ 

For every formula (p over S, 5 € (Tp)^ and I G it holds that ■ 


Proof 

Trivial. □ 


Proposition \4-(\ 

The lattice is a parametrisation of 2^"^ through the mappings (tt/ : Lp —)■ 2^“^ : 
A I ^ A )/^2^p■ 


Proof 

It is clear that the mappings ttj are lattice morphisms since evaluation of proposi¬ 
tional formulas commutes with Boolean operations. Now, for AiAl G L^, it holds 
that ^ if and only if for every atom p G A{p) entails A'{p). This is 

equivalent to the condition that for every p G 'Sj, and every interpretation I G 2 ^“*, 
A{p)^ < A'{p)^ , i.e., with the fact that for every I, •7ri{A) < tti{A') which is what 
we needed to show. □ 


Theorem \4-S\ 

If 7^ is a positive logic program, then 7f> is monotone. For every E-interpretation 
/, it then holds that I V if and only if / ^ T/i(lfp(Tp)). 


Proof 

Follows immediately from the definition of the parametrised well-founded semantics 
combined with Lemma [A. 2 1 □ 


Theorem \4S\ 

For any parametrised logic program V, the following hold: 

1 . T-p is an approximator of Ip. 

2. For every Ep-structure I, it holds that o 7r| = irj oTp. 
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Proof 

1. It follows immediately from the definitions that for exact interpretations S = 
{A, A), 'P-p coincides with Tp. <p-monotonicity follows directly from the definition 
of evaluation of formulas (Definition |4.4[ ) . 

2. We find that for every S S (Lp)'^ and every p S 2^“^, 

= ipfy 

= (^p(5)(p))^ 

= TrjOPp {S){p)), 

which indeed proves our claim. □ 


Lemma A.3 

For every Ep-interpretation /, there are at most |Sd| strict refinements in a well- 
founded induction of 


Proof 

Every strict refinement should at least change one of the atoms in E^ from unknown 
to either true or false, hence the result follows. □ 

Lemma A.f 

Suppose {xi,yi)i<i 3 is a well-founded induction of 7p in which every refinement is 
maximally precise, i.e., either of the form {x,y) lp{x,y) or an unfoundedness 
refinement satisfying the condition in Proposition |2.1| The following hold: 

• there are at most jE^I subsequent strict application refinements in (xi, j/i)i</ 3 , 
and 

• if unfoundedness rehnements only happen in (cci, j/i)i </3 when no application 
refinement is possible, then there are at most |Ed| unfoundedness refinements. 


Proof 

For the first part, we notice that every sequence of maximal application refinements 
maps (by ttj) onto a sequence of maximal application rehnements of Further¬ 
more, from the proof of Proposition 3.3 it follows that if a 7p-reHnement is strict, 
then at least on of the induced 4'|,-rehnements must be strict as well. The result 


now follows from Lemma I A. 31 

The second point is completely similar to the hrst. There can be at most |Ed| strict 
unfoundedness rehnements in any well-founded induction of '^p- Furthermore, the 
condition in this point guarantees that if for some /, an unfoundedness rehnement 
in the induced well-founded induction is not strict, then neither will any later 
unfoundedness rehnements. Hence, the result follows. □ 
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Theorem \5.1\ 

Let £ BC be the language of Boolean circuits. The following hold: (i) Compile(£ bc) 
has polynomial-time complexity and (ii) the size of the output circuit of Compile(£bc') 
is polynomial in the size of V . 


Proof 

First, we notice that if we have a circuit representation of S, then the representation 
of T-piS) consists of the same circuit with maximally three added layers since ipp 
is a DNF for every defined atom p (a layer of negations, one of disjunctions and 
one of conjunctions). Furthermore, the size of these layers is linear in terms of the 
size of V. Similarly, the representation of an unfoundedness rehnement will only be 
quadratically in the size of V (quadratically since computing the smallest y' is a 
rehnement takes a linear number of applications). 

The two results now follow from Lemma |A.4[ which yields a polynomial upper 
bound on the number of rehnements, and which also allows us to ignore the stop 
conditions (in general checking whether a hxpoint is reached is a co-NP problem, 
namely checking equivalence of two circuits; however, we do not need to do this 
since we have an upper bound on the maximal number of rehnements before such 
a hxpoint is reached). □ 


Proposition |5.^[ 

Suppose the parametrised well-founded model of V is {A, A). Let {Aip,Ai, 2 ) be a 
well-founded induction of Tp. Then for every i, Th{Aip) \= Th{A) ^ Th{Ai^ 2 )- 


Proof 


Denecker and Vennekens (2007) showed that if {xi,yi)i<p is a well-founded induc¬ 


tion of A and {x,y) the A-well-founded model of O, then for every * < /3, it holds 
that 


{x^,yi)<p ix,y). 

Our proposition immediately follows from this result. □ 







